SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN THAT I , Hiroyuki Yoshizawa, a citizen 
of Japan residing at Kawasaki, Japan have invented certain 
new and useful improvements in 

ELECTRONIC APPARATUS, CONTROL APPARATUS AND STORAGE MEDIUM 
of which the following is a specification : - 
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TITLE OF THE INVENTION 

ELECTRONIC APPARATUS, CONTROL APPARATUS 
AND STORAGE MEDIUM 



5 BACKGROUND OF THE INVENTION 

This application claims the benefit of a 
Japanese Patent Application No. 11-304627 filed 
October 26, 1999, in the Japanese Patent Office, the 
disclosure of which is hereby incorporated by 
10 reference . 

1. Field of the Invention 

The present invention generally relates to 
^ electronic apparatuses, control apparatuses and 

go storage media, and more particularly to an 

£H 15 electronic apparatus having an electronic mail 

Cj function, a control apparatus for controlling such 

S! an electronic apparatus, and a computer-readable 

j~ storage medium which stores a program for causing a 

T" computer to have the electronic mail function. 

□ 20 In this specification, an electronic 

^ apparatus refers to an apparatus having an 

jtj electronic mail function, and includes computers 

O such as personal computers, word processors, 

electronic notebooks, and intelligent telephone sets 
25 which includes various functions in addition to the 
normal telephone functions. In addition, the 
electronic mail function refers to a function 
including sending and/or receiving electronic mail 
(e-mail). The electronic mail function may of 
30 course include functions of creating and editing 
electronic mail. 

2 . Description of the Related Art 

Conventional electronic mail systems 
basically use a text-based signature file, and an 
35 electronic mail is transmitted by adding a 

predetermined signature file or, by writing a 
signature within a document by character information. 



-2- 



For this reason, the signature file itself does not 
have a specific function. 

A multi-media electronic mail environment 
is already provided, and enables images such as 
5 photographs and/or audio to be included in the 
electronic mail, and also enables processing of 
audio-based or image-based electronic mail. However, 
the signature file remains in the text form, 
f ' Accordingly, if the signature file is 
10 copied, a third person can easily impersonate as 
another person. As a result, it is impossible to 
judge by a simple means whether or not a sender of 
^ the electronic mail is actually the person himself, 

2 thereby making the security of the electronic mail 

15 poor. 

For example, a Japanese Laid-Open Patent 
Application no. 3-106141 proposes a document 
circulating system which displays on a circulating 
document an icon for indicating an existence of a 
2 0 comment. 

In addition, a Japanese Laid-Open Patent 
fy Application No. 5-204795 proposes an electronic mail 

system which has the functions of displaying a 
destination and a portrait of the sender for 
25 confirmation, listing people with the same name or 
position in a file, and transmitting the electronic 
mail based on a symbol such as the portrait. 

Users of electronic mail are increasing 
every year due to the rapid growth of the Internet 
30 and intranet. Recently, communication functions and 
electronic mail software are in many cases installed 
as standard functions in an operating system (OS) . 
Hence, the communication speed is increasing in the 
internet and local area networks (LANs). As a 
35 result, it has recently become possible to exchange 
data having a large size which was realistically 
impossible to exchange conventionally due to the 
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limited communication speed. In addition, even in 
the general electronic mail software and the like, 
documents having the HTML format are supported in 
most cases, and it is anticipated that the number of 
5 users who will use such software will considerably 
increase in the future. Accordingly, it is 
desirable to further improve the electronic mail 
system to suit the multi-media electronic mail 
environment . 

10 However, as is the case of the electronic 

mail system proposed in the Japanese Laid-Open 
Patent Application No. 5-204795 described above, 
_ although the conventional proposed electronic mail 

5 system has the function of transmitting the 

EH 15 electronic mail based on the symbol such as the 

j* s portrait, it is impossible to confirm at the 

SJ receiving end that the received portrait and the 

1H sender of the electronic mail are the same person. 

^ For this reason, it is impossible to prevent a third 

O 20 person from improperly copying the image of the 

25 s ? electronic mail and impersonating as another person, 

ry In other words, there are problems in that there is 

O no simple method of confirming that the sender of 

" the electronic mail is the person himself, and that 

25 the security of the electronic mail is poor. 

In addition, the conventional electronic 
mail system provides no means of simply 
comprehending the importance of the received 
electronic mail or the summary of the contents of 
30 the received electronic mail before reading the 

received electronic mail. As a result, there are 
problems in that the user cannot know the importance 
and the contents of the summary of the received 
electronic mail until the user actually reads the 
35 received electronic mail, and that a so-called junk 
mail cannot be confirmed unless the junk mail is 
actually read. 
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SUMMARY OF THE INVENTION 

Accordingly, it is a general object of the 
present invention to provide a novel and useful 
5 electronic apparatus, control apparatus and 

computer-readable storage medium, in which the 
problems described above are eliminated. 

Another and more specific object of the 
present invention to provide an electronic apparatus, 
10 control apparatus and storage medium which can 

prevent a third person from copying an electronic 
mail and impersonating as another person, enable 
„ confirmation by a simple means that a sender of the 

2 electronic mail is the person himself, and enable 

CP 15 the user to know the importance or summary of the 

contents of the received electronic mail to a 
SJ certain extent before actually reading the received 

p; electronic mail. 

s Still another object of the present 

O 20 invention is to provide an electronic apparatus 

comprising transmitting means for transmitting an 
ry electronic mail in which a symbol including image 

S information which enables a sender to be specified 

^ therefrom is included within signature information 

25 of the electronic mail. 

The electronic apparatus may further 
comprise generating means for generating the image 
information by inputting an image of the sender. In 
this case, the transmitting means may transmit the 
30 electronic mail only when an error between the image 
information generated by the generating means and 
prestored image information is within a 
predetermined range. In addition, the image 
information may include an image related to at least 
35 a face of the sender. 

According to the electronic apparatus of 
the present invention, it is possible to prevent a 
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third person from copying the electronic mail and 
impersonating as another person, and enable 
confirmation by a simple means that the sender of 
the electronic mail is the person himself, so that 
5 the security of the electronic mail is improved. 

The electronic apparatus may further 
comprise adding means for adding to the signature 
information a parameter which indicates an 
importance of the electronic mail. In this case, 
10 the parameter may indicate the importance of the 

electronic mail by a display format of the signature 
information. In addition, the parameter may include 
information which indicates a display priority order 
of the electronic mail. The parameter may include 

jjM 15 character, image and/or audio information indicating 

m 

Zj a summary of the electronic mail. Furthermore, the 

SS information which indicates the display priority 

order of the electronic mail may include at least 
l~ one of a display position and a display timing of 

G 20 the signature information. 

Jjl According to the electronic apparatus of 

f!j the present invention, the parameter which enables 

G comprehension of the importance or the summary of 

^ the contents of the received electronic mail to a 

25 certain extent before actually reading the 
electronic mail, is added to the signature 
information. As a result, it is possible to know 
the importance and the summary of the contents of 
the received electronic mail without actually 
30 reading the received electronic mail, and the so- 
called junk mail can be confirmed without actually 
reading the junk mail. 

The symbol may include information used 
for linking to the sender. 
35 A further object of the present invention 

is to provide an electronic apparatus comprising 
receiving means for receiving an electronic mail in 



which a symbol including image information which 
enables a sender to be specified therefrom is 
included within signature information of the 
electronic mail, and display means for displaying 
5 the image information of the electronic mail. 

The image information may include an image 
related to at least a face of the sender. 

According to the electronic apparatus of 
the present invention, it is possible to prevent a 
10 third person from improperly copying the image of 
the electronic mail and impersonating as another 
person, and to confirm by a simple means that the 
sender of the electronic mail is the person himself. 
The signature information may further 
01 15 include a parameter which indicates an importance of 

the electronic mail, and the electronic apparatus 
%j may further comprise recognizing means for 

ru recognizing the importance based on the parameter. 

The receiving means may receive 
□ 20 information which indicates an importance of the 

signature information, and the electronic apparatus 
«T| may further comprise display control means for 

O displaying, based on the information which indicates 

~ the importance of the signature information, the 

25 signature information on the display means with a 

format which enables recognition of the importance. 
In this case, the information which indicates the 
importance of the signature information may be 
included within the signature information. 
30 The receiving means may receive 

information which indicates a display priority order 
of the signature information, and the electronic 
apparatus may further comprise means for determining 
a display position of the signature information 
35 based on the information which indicates the display 
priority order of the signature information. 

The receiving means may receive 
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information which indicates a display priority order 
of the signature information, and the electronic 
apparatus may further comprise means for determining 
a display timing of the signature information based 
5 on the information which indicates the display 
priority order of the signature information. In 
this case, the information which indicates the 
display priority order of the signature information 
may be included within the signature information. 

10 The signature information may include 

character, image and/or audio information indicating 
a summary of the electronic mail. 

The symbol may include information used 
for linking to the sender. 

15 Another object of the present invention is 

to provide an electronic apparatus comprising 
receiving means for receiving an electronic mail 
including at least signature information and 
information which indicates an importance thereof, 

20 display means for displaying the electronic mail, 
and display control means for displaying the 
signature information on the display means with a 
format which enables recognition of the importance, 
based on the information which indicates the 

2 5 importance. 

Still another object of the present 
invention is to provide an electronic apparatus 
comprising transmitting means for transmitting an 
electronic mail by adding to signature information 

30 of the electronic mail a parameter which indicates 
an importance of the electronic mail. 

According to the electronic apparatus of 
the present invention, the parameter which enables 
comprehension of the importance or the summary of 

35 the contents of the received electronic mail to a 
certain extent before actually reading the 
electronic mail, is added to the signature 
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information. As a result, it is possible to know 
the importance and the summary of the contents of 
the received electronic mail without actually 
reading the received electronic mail, and the so- 
5 called junk mail can be confirmed without actually 
reading the junk mail. 

A further object of the present invention 
is to provide a control apparatus for an electronic 
apparatus having transmitting means, comprising 
10 control means for controlling the transmitting means 
to transmit an electronic mail in which a symbol 
including image information which enables a sender 
to be specified therefrom is included within 
signature information of the electronic mail. 

5: 15 Another object of the present invention is 

m 

to provide a control apparatus for an electronic 
4 apparatus having receiving means for receiving an 

p! electronic mail and display means for displaying the 

~~ received electronic mail, comprising control means 

O 20 for controlling the receiving means to receive an 

electronic mail in which a symbol including image 
fy information which enables a sender to be specified 

G3 therefrom is included within signature information 

of the electronic mail, and for controlling the 
25 display means to display the image information of 
the electronic mail. 

Still another object of the present 
invention is to provide a control apparatus for an 
electronic apparatus having receiving means for 
30 receiving an electronic mail including at least 
signature information and information which 
indicates an importance thereof and display means 
for displaying the received electronic mail, 
comprising display control means for controlling the 
35 display means to display the signature information 
with a format which enables recognition of the 
importance, based on the information which indicates 



the importance. 

A further object of the present invention 
is to provide a computer-readable storage medium 
which stores a program for causing a computer to 
have an electronic mail function, comprising 
transmitting means for causing the computer to 
transmit an electronic mail in which a symbol 
including image information which enables a sender 
to be specified therefrom is included within 
signature information of the electronic mail. 

Another object of the present invention is 
to provide a computer-readable storage medium which 
stores a program for causing a computer to have an 
electronic mail function, comprising receiving means 
for causing the computer to receive an electronic 
mail in which a symbol including image information 
which enables a sender to be specified therefrom is 
included within signature information of the 
electronic mail, and display means for causing the 
computer to display the image information of the 
electronic mail. 

Still another object of the present 
invention is to provide a computer-readable storage 
medium as which stores a program for causing a 
computer to have an electronic mail function, 
comprising receiving means for causing the computer 
to receive an electronic mail including at least 
signature information and information which 
indicates an importance thereof, display means for 
causing the computer to display the electronic mail, 
and display control means for causing the computer 
to display the signature information by the display 
means with a format which enables recognition of the 
importance, based on the information which indicates 
the importance. 

According to the storage medium of the 
present invention, it is possible to prevent a third 
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person from Improperly copying the image of the 
electronic mail and impersonating as another person, 
and to confirm by a simple means that the sender of 
the electronic mail is the person himself. 
5 Therefore, according to the present 

invention, it is possible to prevent a third person 
from improperly copying the image of the electronic 
mail and impersonating as another person, and to 
confirm by a simple means that the sender of the 
10 electronic mail is the person himself, thereby 

improving the security of the electronic mail. In 
addition, the parameter which enables comprehension 
^_ of the importance or the summary of the contents of 

2 the received electronic mail to a certain extent 

ff 1 15 before actually reading the electronic mail, is 

Irj added to the signature information. As a result, it 

S| is possible to know the, importance and the summary 

|^ of the contents of the received electronic mail 

~~ without actually reading the received electronic 

O 20 mail, and the so-called junk mail can be confirmed 

-T, without actually reading the junk mail. 

111 Other objects and further features of the 

Q present invention will be apparent from the 

^ following detailed description when read in 

25 conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective view showing an 
embodiment of an electronic apparatus according to 
30 the present invention; 

FIG. 2 is a system block diagram for 
explaining the construction of an important part 
within a main body of a computer system; 

FIG. 3 is a flow chart for explaining the 
35 operation of a CPU of the computer system which 
forms a transmitting end apparatus; 

FIG. 4 is a diagram showing an embodiment 
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of a multi-media signature file which is displayed; 

FIG. 5 is a flow chart for explaining the 
operation of the CPU of the computer system which 
forms a receiving end apparatus ; 
5 FIG. 6 is a diagram showing a normal 

electronic mail; 

FIG. 7 is a diagram showing a state where 
the multi-media signature file is displayed on a 
display before a mail text of an electronic mail; 
10 FIG. 8 is a diagram showing a state where 

the multi-media signature file is displayed on the 
display within the mail text of the electronic mail; 

FIG. 9 is a diagram showing a state where 
the multi-media signature file is displayed on the 
15 display after the mail text of the electronic mail; 

FIG. 10 is a flow chart showing a part of 
the process shown in FIG. 5 in more detail; and 

FIG. 11 is a flow chart for explaining the 
operation of the CPU of the computer system which 
20 forms a receiving end apparatus. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A description will be given of embodiments 
of the present invention, by referring to the 
2 5 drawings. 

FIG. 1 is a perspective view showing an 
embodiment of an electronic apparatus according to 
the present invention. In this embodiment, the 
present invention is applied to a desk-top type 

30 computer system, however, the present invention is 
of course similarly applicable to a portable type 
computer system. This embodiment of the electronic 
apparatus employs an embodiment of a control 
apparatus according to the present invention which 

35 controls the electronic apparatus. 

A computer system 100 shown in FIG. 1 
generally includes a main body 101 which includes a 
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CPU, a disk drive unit and the like, a display 102 
for displaying an image on a display screen 102a in 
response to an instruction from the main body 101, a 
keyboard 103 for inputting various kinds of 
5 information to the computer system 100, a mouse 104 
for specifying an arbitrary position on the display 
screen 102a of the display 102, a modem 105 for 
accessing an external database or the like and 
downloading a program or the like stored in another 
10 computer system, an image pickup unit 120 made of a 
CCD camera or the like, and one or more speakers 121 
for reproducing sound. 

A program (electronic mail software) which 
causes the computer system 100 to have an electronic 
01 15 mail function is stored in a portable recording 

?\ medium such as a disk 110 or, is downloaded from a 

Sj recording medium 106 of another computer system 

using a communication unit such as the modem 105- A 
7" computer-readable storage medium according to the 

□ 20 present invention is formed by a recording medium 

!r! such as the disk 110 which stores the program. A 

ffj recording medium which forms the computer-readable 

Q storage medium according to the present invention is 

D 

not limited to portable recording media such as the 
25 disk 110, IC card memory, floppy disk, magneto- 
optical disk and CD-ROM, but also includes various 
kinds of recording media accessible by a computer 
system which is connected via a communication means 
or a communication unit such as the modem 10 5 and a 
30 LAN. 

FIG. 2 is a system block diagram for 
explaining the construction of an important part 
within the main body 101 of the computer system 100. 
In FIG. 2, the main body 101 generally includes a 
35 CPU 201, a memory part 202 including a RAM, ROM and 
the like, a disk drive 203 for the disk 110, and a 
hard disk drive (HDD) 204 which are connected via a 
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bus 200. In this embodiment, the display 102, the 
keyboard 103, the mouse 104, the image pickup unit 
120 and the like are connected to the CPU 201 via 
the bus 200 as shown in FIG. 2, but these elements 
5 may of course be connected directly to the CPU 201. 
In addition, the display 102 and the image pickup 
unit 120 may be connected to the CPU 201 via a known 
graphic interface (not shown) which processes input 
and output image data. 

10 The construction of the computer system 

100 is of course not limited to that shown in FIGS. 
1 and 2, and various other known constructions may 
be used instead. 

First, a description will be given of the 

15 operation when the computer system 100 forms a 

transmitting end apparatus. FIG. 3 is a flow chart 
for explaining the operation of the CPU 201 of the 
computer system 100 which forms the transmitting end 
apparatus. The process shown in FIG. 3 corresponds 

20 to a program which is stored in a first embodiment 

of the computer-readable storage medium according to 
the present invention. 

In FIG. 3, a step 31 decides whether or 
not a mailer which generates a multi-media signature 

25 file at the transmitting end is started. When the 
decision result in the step 31 becomes YES, a step 
32 creates a mail text or body of an electronic mail 
by a procedure similar to a known procedure used to 
create a text-based electronic mail. A signature 

30 file generally refers to a file which includes 

personal information of the user. On the other hand, 
a multi-media signature file refers to a signature 
file which adapts to multi-media. In this 
embodiment, the mailer creates an electronic mail in 

35 a HTML language which can simultaneously input audio 
and image in a multi-media format such as the HTML 
format or, in a language which conforms to the HTML 



language. By using the HTML language which adapts 
to the multi-media, it is possible to include media 
such as the audio and image into the multi-media 
signature file. 

At a stage where the electronic mail is to 
be transmitted, a step 33 starts a signature 
creating wizard for creating a multi-media signature 
file. A step 34 inputs personal information which 
is input by the user (sender) from the keyboard 103 
or the like. The personal information includes 
information such as a name, position, URL of home 
page, telephone number, mail address, and Nifty ID, 
for example, which are necessary for the multi-media 
signature file. 

A step 35 inputs an image which is input 
from the image pickup unit 120, including a face of 
the sender. The image which is input may be a still 
picture or a motion picture. 

A step 36 carries out an image processing 
such as framing, with respect to the input image. 
The frame which is added to the input image and an 
accessory frame which is added to the multi-media 
signature file may be selected and determined 
depending on the user's preference. In addition, a 
step 37 inputs a parameter which is input from the 
keyboard 103 or the like by the user (sender) and 
indicates an importance of the electronic mail. 

The parameter includes at least one of 
information which indicates a display priority order 
of the electronic mail, and character, image and/or 
audio information which indicates a summary of the 
electronic mail. In addition, the information which 
indicates the display priority order of the 
electronic mail includes at least one of a display 
position and a display timing of the multi-media 
signature file. In other words, it is possible to 
indicate a display priority position of the 
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electronic mail by at least one of the display 
position and the display timing of the multi-media 
signature file. Accordingly, the importance of the 
electronic mail can be indicated by a display format 
5 of the signature file, and the electronic mail can 
be displayed with a format which enables recognition 
of the importance of the electronic mail by changing 
the display position or the display timing of the 
signature file. 
10 In the above described manner, 

preparations are made to transmit the electronic 
mail in which a symbol including image information 
^ which enables the sender to be specified therefrom 

is included within the signature file of the 
8} 15 electronic mail. In this embodiment, the symbol 

£ s includes image information and personal information 

S| of the sender, which enable the sender to be 

r - specified, and the parameter is added to the multi- 

media signature file. Thus, information used for 
□ 20 linking to the sender is included in the symbol. 

The information (parameter) which 
hj indicates the display priority order may be included 

O in a header of the electronic mail or the mail text, 

^ instead of including the information (parameter) 

25 within the multi-media signature file. Furthermore, 
a parameter which indicates the importance of the 
electronic mail may replace the information or 
parameter which indicates the display priority order. 

FIG. 4 is a diagram showing an embodiment 
30 of the multi-media signature file which is displayed. 
In FIG. 4, displayed information includes an image 
(input image) 1 of the user (sender), a frame 2 
added to the input image 2, an accessory frame 3 
added to the multi-media signature file, and 
35 personal information 4. 

A step 38 decides whether or not an error 
between the image input in the step 35 and an image 
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which is prestored in the memory part 202 or the 
like and includes the face of the user (sender) is 
within a predetermined range. The process returns 
to the step 35 if the decision result in the step 38 
5 is NO. On the other hand, if the decision result in 
the step 38 is YES, a step 39 decides whether or not 
a mailer on a receiving end is adapted to the multi- 
media signature file. If the decision result in the 
step 39 is NO, a step 40 includes the multi-media 
10 signature file within the electronic mail, and the 
process advances to a step 41. On the other hand, 
the process advances to the step 41 if the decision 

^ result in the step 39 is YES. 

The decision in the step 39 is made based 

01 15 on a selection which is made by the user from the 

mouse 104, for example. That is, the decision in 

~-j the step 39 is made based on the selection which 

determines whether or not the electronic mail is to 

~~ be transmitted for a mailer which is adapted to the 

Q 20 multi-media signature file. 

!fr! The step 41 enables transmission of the 

nj electronic mail. In addition, a step 42 transmits 

O the created electronic mail to a communication 

u network such as the Internet via a known mail server 

25 (not shown), and the process ends. 

Next, a description will be given of the 
operation when the computer system 100 forms a 
receiving end apparatus having a mailer which is 
adapted to the multi-media signature file. FIG. 5 
30 is a flow chart for explaining the operation of the 
CPU 201 of the computer system 100 which forms the 
receiving end apparatus. The process shown in FIG. 
5 corresponds to a program which is stored in a 
second embodiment of the computer-readable storage 
35 medium according to the present invention. 

In FIG. 5, a step 11 decides whether or 
not a mailer at the receiving end, which is adapted 
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to the multi-media signature file, is started. When 
the decision result in the step 11 becomes YES, a 
step 12 receives an electronic mail from a 
transmitting end apparatus via a communication 
5 network such as the Internet and a known mail server 
(not shown). In this embodiment, it is assumed for 
the sake of convenience that the received electronic 
mail has been created by the process described above 
in conjunction with FIG. 3. Further, it is assumed 
10 that information p which indicates the display 

priority order of the electronic mail is added to 
the multi-media signature file as the parameter 
^ indicating the importance of the electronic mail or, 

0 the parameter is included in the mail text or header 

3H 15 of the electronic mail. 

f : A step 13 decides whether or not the 

~j received electronic mail includes a multi-media 

*y signature file. If the decision result in the step 

y* 13 is NO, the received electronic mail is a normal 

□ 20 or ordinary electronic mail such as that shown in 
jj FIG. 6, and thus, a step 14 displays the normal 

{§ electronic mail on the display 102 by a known means, 

□ and the process ends. The normal electronic mail 
~ shown in FIG. 6 is not adapted to the multi-media 

25 signature file, and is basically text-based. 

On the other hand, if the decision result 
in the step 13 is YES, a step 15 displays the 
received electronic mail on the display 102 by 
including the importance of the electronic mail in a 

30 list of the electronic mail. In this embodiment, 
the received electronic mail is displayed by 
including the display priority order information p 
in the electronic mail. In this case, the list of 
the electronic mail is basically the same as a known 

35 list, except that an item corresponding to the 
display priority order information p is added. 

A step 16 displays the multi-media 



■18- 



signature file on the display 102, based on the 
display priority order information p. If it is 
assumed for the sake of convenience that there are 
three kinds of display priority order information p 
5 and that the lower the value of the display priority 
order information p the higher the display priority 
order, the process advances to a step 17 if the 
display priority order information p is p = 0 , to a 
step 18 if p = 2, and to a step 19 if P 3. 

10 If the display priority order information 

p is p = 1 which indicates the highest importance of 
the electronic mail, the step 17 displays the multi- 
media signature file before or in front of the mail 
text of the electronic mail displayed in a step 20. 

15 FIG. 7 is a diagram showing a state where a multi- 
media signature file 500 is displayed on the display 
102 before the mail text of the electronic mail. 
When the importance of the received electronic mail 
is high as in this particular case, the multi-media 

20 signature file 500 is displayed before the mail text 
of the electronic mail, so that the user (recipient) 
can first confirm the sender of the received 
electronic mail. In this case, the information of 
the sender specified by the multi-media signature 

25 file 500 has an extremely high reliability, because 
measures are taken by the process shown in FIG. 3 so 
that a third person cannot impersonate the sender. 
Accordingly, the recipient can confirm by a simple 
means that the sender is the person himself. In 

30 addition, since the multi-media signature file 500 

is displayed first, that is, before the mail text of 
the electronic mail, the recipient can comprehend 
the importance and summary of the contents of the 
received electronic mail to a certain extent before 

35 actually reading the received electronic mail, 

thereby making it possible to distinguish important 
electronic mail from junk mail and the like. 
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If the display priority order information 
p is p = 2 which indicates the medium importance of 
the electronic mail, the step 18 displays the multi- 
media signature file within the mail text of the 
5 electronic mail when displaying the electronic mail 
in the step 20. FIG. 8 is a diagram showing a state 
where the multi-media signature file 500 is 
displayed within a mail text 501 on the display 102. 
When the importance of the received electronic mail 
10 is medium as in this particular case, the multi- 
media signature file 500 is displayed within the 
mail text 501 of the electronic mail, so that the 
user (recipient) can receive the electronic mail 
similarly to the normal or ordinary electronic mail. 
15 Accordingly, since the multi-media signature file 
500 is displayed within the mail text 501 of the 
SI electronic mail, the recipient can comprehend the 

j*j importance and summary of the contents of the 

received electronic mail to a certain extent before 
20 actually reading the received electronic mail. In 
this embodiment, the multi-media signature file 500 
which is displayed within the mail text 501 is made 
up of personal information, similarly as in the case 
of receiving the normal electronic mail, however, it 
25 is of course possible to also display image 

information and the like of the sender as in the 
case shown in FIG. 7. 

If the display priority order information 
p is p = 3 which indicates the lowest importance of 
30 the electronic mail, the step 19 adjusts a 
processing sequence so that the multi-media 
signature file is displayed after or in rear of the 
mail text of the electronic mail displayed in the 
step 20. FIG. 9 is a diagram showing a state where 
35 the multi-media signature file 500 is displayed 

after the mail text 501 on the display 102. When 
the importance of the received electronic mail is 
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lowest as in this particular case, the multi-media 
signature file 500 is displayed after the mail text 
501 of the electronic mail, so that the user 
(recipient) can simply judge whether or not to 
actually read the received electronic mail. In 
other words, because the multi-media signature file 
500 is displayed after the mail text 501, the 
recipient can comprehend the importance and summary 
of the contents of the received electronic mail to a 
certain extent before actually reading the received 
electronic mail. 

FIG. 10 is a flow chart showing the 
process of particularly the steps 11 through 13 
shown in FIG. 5 in more detail. In FIG. 10, steps 
61 through 65 correspond to the steps 11 through 13 
shown in FIG. 5, a step 66 corresponds to the step 
14 shown in FIG. 5, and a step 67 corresponds to the 
steps 15 through 20 shown in FIG. 5. In the process 
shown in FIG. 10, the display priority order 
information p is used as a flag, and a decision to 
determine whether the received electronic mail 
includes the multi-media signature file is made 
based on this flag. 

In FIG. 10, the step 61 decides whether or 
not the mailer at the receiving end is started. 
When the decision result in the step 61 becomes YES, 
the step 62 receives the electronic mail from the 
transmitting end apparatus via the communication 
network such as the Internet and a known receiving 
end mail server (not shown) . The step 63 confirms 
the received electronic mail which is received by 
the receiving end mail server. The step 64 inputs a 
header file of the received electronic mail, and the 
step 65 decides whether or not the input header file 
includes the flag which indicates the existence of 
the multi-media signature file. More particularly, 
this embodiment uses the display priority order 
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inf ormation p as the flag. 

Accordingly, when the received electronic 
mail is a normal or ordinary electronic mail having 
no flag, the process advances to the step 66 which 
5 carries out a mail process similar to that with 
respect to the normal electronic mail, and the 
process ends. On the other hand, if the received 
electronic mail includes the multi-media signature 
file and the flag exists, the process advances to 
10 the step 67 which carries out the mail process 

adapted to the multi-media signature file, and the 
process ends. 

e~ As described above, the parameter which 

yg indicates the importance of the electronic mail 

ff 1 15 includes at least one of the information indicating 

the display priority order of the electronic mail, 
and the character, image and/or audio information 
indicating the summary of the electronic mail. In 
addition, the information indicating the display 
20 priority order of the electronic mail includes at 

least one of a display position and a display timing 
fy of the multi-media signature file. In the 

w embodiments described above, the information 

indicating the display priority order of the 
25 electronic mail is used as the parameter, however, 
the user (recipient) can similarly comprehend the 
importance of the received electronic mail when the 
character, image and/or audio information indicating 
the summary of the electronic mail is used as the 
30 parameter. For example, the character information 

indicating the summary of the electronic mail may be 
related to a summary or the like of the mail text of 
the electronic mail. The image information 
indicating the summary of the electronic mail may be 
35 related to the kind or nature (urgent, normal, 

circulating, and the like) of the mail text of the 
electronic mail. Moreover, the audio information 
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indicating the summary of the electronic mail may be 
related to an audio message for informing the kind 
or nature of the mail text of the electronic mail, 
for example. In this case, the audio message can be 
5 reproduced by a known means such as a plug- in driver 
module, and output from one or more speakers 121 
shown in FIG . 1 . 

Next, a description will be given of the 
operation when the computer system 100 forms a 

10 receiving end apparatus having a mailer which is not 
adapted to the multi-media signature file. FIG. 11 
is a flow chart for explaining the operation of the 
CPU 201 of the computer system 100 which forms the 
receiving end apparatus. The process shown in FIG. 

15 11 corresponds to a program which is stored in a 
third embodiment of the computer-readable storage 
medium according to the present invention. 

In FIG. 11, a step 51 decides whether or 
not the mailer at the receiving end, which is not 

20 adapted to the multi-media signature file, is 

started. When the decision result in the step 51 
becomes YES, a step 52 receives an electronic mail 
from a transmitting end apparatus via a 
communication network such as the Internet and a 

25 known mail server (not shown). A step 53 displays a 
list of the received electronic mail on the display 
102. A step 54 includes the multi-media signature 
file within the mil text of the electronic mail. A 
step 55 displays the mail text of the electronic 

30 mail, including the multi-media signature file, on 
the display 102, and the process ends. 

In a case where the sender knows 
beforehand that the recipient is not adapted to the 
multi-media signature file, and the step 40 in the 

35 process shown in FIG. 3 includes the multi-media 
signature file within the mail text of the 
electronic mail to process the same as a single 
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electronic mail, the received electronic mail is 
processed similarly to the normal electronic mail by 
the process shown in FIG. 11. However, the sender 
may indicate the importance of the electronic mail 
5 by a position in the electronic mail where the 

multi-media signature file is included. For example, 
by including the multi-media signature file at a 
beginning of the mail text of the electronic mail, 
the recipient may comprehend from the multi-media 

10 signature file which is displayed at the beginning 
position of the mail text of the electronic mail 
that the importance of the electronic mail is high. 

Moreover, in the embodiments, the display 
position or the display order of the multi-media 

15 signature file is changed depending on the parameter 
which indicates the display priority order or the 
parameter which indicates the importance. However, 
the display position or the display order of the 
signature file which includes no image information 

20 or the signature part within the electronic mail may 
be changed depending on the display priority order 
or the importance. In the case of such a 
modification, the technique used to change the 
display position or the display order of the 

2 5 signature file in the embodiments described above 
may be employed to change the display position or 
the display order of the signature consisting solely 
of characters, so that the display is made with a 
format which enables recognition of the importance. 

30 In the embodiments described above, the 

image which includes the face of the sender is a 
still picture or a motion picture which is picked up. 
However, the image which includes the face of the 
sender may be a drawn portrait or an animation. In 

35 other words, the image information which enables the 
sender to be specified in each of the embodiments 
described above includes still picture, motion 
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picture, drawn portrait, animation and the like. 

Further, the present invention is not 
limited to these embodiments, but various variations 
and modifications may be made without departing from 
5 the scope of the present invention. 
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